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M EJvJOR ANDU Ivl FOR MR. FROEHLKE 


i JbiTECT: Summary Critique of .blue Ribbon Panel Report on Intelligence 


The body of the Panel Report i« on the whole excellent. With 
certain exceptions discussed below, the report highlights tne major 
. • : • .••tcomii'j j? s of the Defense intelligence community . Not since the 
;fco‘ at study Group of I960 has such an. encompassing review of the 
hvh.nse intelligence community been made. The report outlines the 
int--r relation ships of the major components of the Defense intelligence ‘ 
community and describes in blunt and direct language many of its 

1 ! 

, ! ! 

The recommendations of the panel are in the main cogent anci to 
i.., : . sported. The establishment of an Assistant Secretary of Defense 
cii C :-c--suousiMii<w to direct aD DOD intelligence activities "-n 

national programs would provide an unambiguous policy management 


rase intelligence community. 

■ .! 1 

With respect to the general recommendations on restructuring 
t >. e Defense intelligence community (on page 47), I suggest you strongly 

c„.c„ r ; " ' ■ I 

With respect to the proposed ASD/I (DDI) and his specific respom 

, I s 

Abilities, I suggest you also concur. 

c” , s 

.H •*' l 

With respect to the formation of explicit functions under the 

ASD/I ‘(DDI) to direct all Defense- intelligence collection and production 
activities, (i. e. , DS ECO and DIP A) I suggest you concur. However, T ’ 
be-ieve a major problem exists in the vagueness' of recommendations 
on processing, reporting, and dissemination responsibilities attributed 
to the DSECC. Thus, I suggest you take the following exceptions with 
respect to these recommendations. 


i 


DIA and OSD have no objection to declassification 
and release. 


DIA and OSD review(s) completed. f*. •* . a A - r ft V" 
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men 
proc 
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Men' 


a< Processing: In view of the fact that the: primary function 
q F orocessim 1 3.s to provide col.l.cCi.e(i raw intelligence m 
a format suitable for production use, the; processing 
output fo at: should he determined by the pi eduction 
function, in this car. o, the DIPA. 

li, B eportin.g: The DIP A should bo responsible for all 
intelligence reporting to non --intelligence consumers. 

If DSECC is allowed to make intelligence reports to 
consumers, the production function and its conti ol 
embodied in DIPA will soon lie dissipated. 

c. Dissemination: In a similar context the DIP A should 

be responsible for all intelligence reports dissemination 
to non-intelligence consumers. 

One major shortcoming I find with the panel report find its recorn 
nations is that is does not systematically relate the intelligence 
, * s s o s which it discusses to tire organisations it establishes in the 
mmbnoarions. A large part of my detailed critique m the attacned 

lorandum for the Record deals with this problem and its consequences 

-1 



vlj lb d d ■ / C- 

Wallace E. Seidel 
Director of CIRIS 
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M'^IORANDUM for the record 

SUBJECT: Critique of Blue Ribbon Panel Report on Intelligence 


, . r . ■ 

The Blue Ribbon Panel Report on intelligence contains two specific 
sections. The first section discusses* the problems and ills of Defense 
j;V--'!]i‘ i encc and its management. The second section offers a series of 
recommendations which arc designed to result in a more efficient a no 
effective Defense intelligence organisation. 

' ■ J • 3 ; ■ •■7 | 

■ The panel discussion of the shortcomings of current Defense 
•intelligence organization is on the whole quite excellent. 

i I 

The brief Part I on the intelligence community clearly points to 

i 

a. the need for consideration of Defense inputs to USIB 

■f i I 

; 

b. , the lack of consumer input and 

I 

c. the water ed-down estimate problem. 

■ j | 

The Part II of the report deals with Defense intelligence. 

1 I 

The discussion of the Cryptologic program primarily centers upon 

■mo r robiems of DIRNSA management control over the SCA’s. The report 

A,.; A t- 0 . point out the problems of (1) the relationships of NSA to the 

c. -jd\ etion function embodied in the NSCiD 6 enjoinaer regarding '•prociuclioi 

of finished intelligence", the "technical information problem, " ana the 

i n?' h i • itv of production to identify tne sources oi information in COtvilUT 

reporting" as noted in the DINS report, and (2) the problems of OSD 

,vd;:?ron of the COMINT' input relative to other sensors for any given 

"... * 1 
target objective. 

■ , | 
The discussion of the General Defense Intelligence Program clearly 

points out the problem of DIA. and its relationship' to OSD, JCS,, anci the 
Serv ,ws. . ' ' 'I 

'' | 

Jn the Panel Report's discussion of the intelligence process the 

prefacing remarks note the lack of a mechanism to effect a proper 
resource balance between the process functions and notes that tnere is 
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evidence that, (a) much more .information is being collected than pjoccssoti 

and fb) "unouauvi.onably" more can be processed 1han cam be used mo . 

; : i 

pr o(uiv. i.iv*} . . 

. ! 

The main point in the discussion on collection is that there is; no 

effective mechanism .for economic;; 3 ly rolati ng collection resources i.o 
heed. Tho processing discus si on fails to recognize that processing 
presents a ma jor pi* obi ojtj for intelligence management. ]; or example, 
although the report recognizes tho processed output must be in a form 
suitable for use by the production function , it fails to note that (a) the 
key. problem is one of what specific information regarding the source is 
passed to the producer; (b) the inability of the producer to control proces-* 
ring output form particularly when processing is controlled by tne 
collector (e. g. the COMINT case); (c) that processing also provides 
feedback information to collection and when collector dominated, that 
function tends to dominate the major purpose of processing; and (d) 
that the processing function provides a natural base for deriving 
individual sensor information gain relative to a given target tvmle only 
the •oroduction function can provide the net or integrated information 
aain relative to all sensors for a given target. 


The discussion, of 


clearly point 


out th 


but fails to note the. inputs to any AS D/i manag enient evaluation program 
which the production function must make. It does not systematically 
discuss the relationship of the producer to requirements of all kinds, 
and .to the collection, processing and management function. 


The discussion of Evaluation is prefaced with the note that "only 
a small proportion of the intelligence produced is useful. " The panel 
fails to discuss evaluation in terms of management ability to determine 
consumer r'eeds and oroduct value ro the consumer. 

c 5 ; * i 

The discussion of Special Programs is necessarily limited by 
the classification of. the report. Although the panel recognized the problem 
of the "National" program relation to community and defense intelligence 
it failed to follow through in a discussion of the existing committee problem. 

_ ' i 

The B e commendations 

- ; ' ■■ N i 

The recommendations on the functions of the ASD/I (DDI) are 
u/ebablv v.wue in several areas because of the classification problem. 
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sot explicit with respect to the relation of 


For example; it i: 
ire ASD/'I to the current h3gh level committee lor Special Activities 
or Iho Special Activities themselves. 


The responsibility to direct all intelligence activities does not 


specifically include all intelligence related R&D although thi: 


is m 


The problem of review and evaluation .procedures of the new 
-ASD/i have not been dealt with explicitly and systematically in the Blue 
Ribbon Panel Report. 


In any evaluation concept of the Defense or community intelligence 
system certain basic functions or processes must be carried out. 


(1) First, we need to know who the players in the game 
are, what resources they have, and how those resources are distributed 
by intelligence function and objective. Tins is the function of CJ.RIS in 
the evaluation effort. 


( 2 ■) Second, we, must know how we know what we know. That 
is to say, we must have an explicit knowledge of (a) experienced sensor., 
information gnin relative to 4 specific sensors and specif? c to 4| * gets This 
can most easily be accomplished by ASD/I tasking of sensor processing 
and the setting up of individual sensor or station data bases relative to 
specific substantive targets. 


(3) Third, we must have an integrated .or net output of all 


I 


sensor experienced information gain relative to specific substantive 
targets. Since the production function is the locus of the integral: 
base for any substantive target, DIPA must provide this input to ASD/I 
evaluation effort. 4 • 

# ■ 


(4) It dhoufc! be understood that experienced sensor information 
gain or net (all sensor) information gain for any given target, only provides 
an explicit empirical expression of knowledge or information gained. It 
does not provide the relative value of the information gained. 


I 


(5) The value of the intelligence service can only be derived 
from the consumer of the service. The panel report makes several 
reference to the lack of consumer inputs in the intelligence process. 
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ji!U'iH",oncc vnliKi enal.y ::i s hn i v.-f> source?* of data. .Liie first, is a 
.i; , and explicit cxpros sion of consumer need (i. c. , the so called 
ccn.unner -requirement). In a world of mull i ••coiruimoj's both ho ri ~ 

■/, ie i i ' ; : .1 1 y and vertically organized bur eaucrnid c: ; v 1. 1. y. consumer nee.u 
.analysis is an essentia"!, function of the .A.SD/l evaluation effort. 

Tli e. second source of value dqva is feedback' J.unction from me 
consumer to intelligence. This involves ’’.Product Evaluation"— and 
.must also lie organized as an explicit effort in the ASD/I Evaluation 
effort.' 


i 


(6) The final and probably most important facet of the 
ASD/1 evaluation program, is the projection of resource capabilities 
for ail functions and consumer needs in order to evaluate decisions on 
procurement and R&D resources as they relate to specific substantive 
targets and objectives, (i. e. , true resource planning relaceo to objectives) 


In this instance, the final input necessary are 

(a) target projections derived from estimates and 
threat assessments. 

.(b) technical characteristics data for systems which 
have not yet-been operational and 


I 


(c) R&'D project definitions related to intelligence 


:tives . 


* 

(7) Again all of this data should flow through the production 
function in order to get DIPA to provide the relative expected imormation 
gain fa: all individual sensor resources with respect to a given sub- 
stantive target or objective. 

" ~ I 

By way of summary of a.n ASD/I evaluation program relative to 
consumers and his DSECC and DIPA arms, the conceputal diagram is 
as follows: . ’ 


!■/ I have attached Don Harris' paper as the best available exposition of 
the Product Evaluation problem. 
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ASD/I Evaluation Program Concept 
Input Struc ture 


t-> 7 <”* 

1 k'J.Ut,' 

si' 

inputs from ./ 

! 

i 

i 

Sensor * 

Target ‘ 

Information 

Gain (Current or Projected 

DJ PA und Service 
Combatant Intelligence 
Forces 


\/ 

Inputs from DSECC 

§ 

(possibly from. Combatant 
Intelligence Forces) 

Net (Integrated) Target | 

: 

t 1 

Consumer Need Analysis & ; 

Information 

i 

l 

| Product Evaluation j 

Gain (Current or 

’Projected) 



nput s 

from DIP A 


Inputs from Consumers 
(Analysis by ASD/I Staff) 


Output Structur e 

^ ^ •. ^ ^ ^ _ . j, 

’’ ASD/I Resource Analysis Group 

-j-- - 

Outputs: Relative valuejaf 
specific collection resources 
to objectives. Impact on 
•Processing and Production 
Associated Support Costs. 


*'?*/>, (ft ?* s ; !;b 
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Tile recommended responsibilities of the DSECC raises sjgnificaij 


I 


problems end again there is a vagueness with respect to definitions and 


For example, 

l! The DSECC should perform those processing activities which 
arc most efficiently associated with collection facilities. 11 This provides, 
r.o specific criteria and begs the processing relation to the production 
function and the management evaluation problems of the ASD/I. 

I 

If processing must put raw collected data, in a form suitable for 
use by the producer, the producer must be able to control format and 
data inputs. He has not historically been able to do this when processing 
has been controlled by the collector. 

I 

This also becomes a problem, in the first responsibility listed for 
the DSECC particularly with respect to "reporting". The problem of 
"Finished Intelligence" as a production function has been with us for 
yours. Does NS A produce finished intelligence or doesn't it? NSCID 6 
says no ! The direct passage of NS A intelligence to the White House and 

A I 

t , / i ■ . r f 1 ! - /»•> , i <* * i ■» ■» <• * 

v)i A (mW'.'i nu y .■ UlliC j'Wl.'' JL J O Cu.wi U1 UJ. ctj.L COllCt UOJJ f Chin.; uU.") _ 

I 

will only serve to accentuate this problem, unless its reporting and 
dis semination outside ox the community is controlled by DIP A. One 
answer may well be to take a. large part of NSA Production and Reporting 
and place it under the DIPA. 


The DSECC is also to serve as. Director of NSA. What then is 
his relationship to the Director's of Special Activities since DSECC is 
tc command all Defense collection activities? Why is he not also 
Director of those Special Activities and also Director of the specific 
collection activities now £ound in the C-DIP? 


DSECC is responsible to insure the most judicious use of common 
staff elements between his DSECC and NSA. Why not also include the 
staff of the Special Activities and DIA collection staff? 


DSECC responsibility (4) again raises the reporting problem and 
its relation to Production (DIPA). Should not DIPA have a control voice 
in DSECC dissemination of intelligence information particularly to 


I 


V-<JJ ; £> J 


*rs? 


Approved For Release :.tSTA^pl9M00097A0001 00030005-4 




Approved For Release 2002/10/21 : CIA-RDP79M00097A0001 00030005-4 


•or reporting specific stnsov in formation gain rclativ 


source. 


A'-'- noted oaj'jj. 


l-O a 
• the 


rm ! ural location for the individual. . 


; i'A : ;:.r ; ;c!..aiid n given c. o.Ll.ec tu-n re 
.••v.’.isi'-r p roc i : s s i.n g fun Ohio a pr e seats >' 
roje'or data base as it relates to specific substantive target:; . Obv i ou s 1 y, 
iff! is rgt'l designation must be of common defi nitron for bot’l) DSFCD and: 

; i ).l l V\ . '. ' I 

I 

The point is that although the DS11CC sensor data base may reveal 
an 'information gain relative to a given -target the integrated substantive 
Bata. Base of DIPA must determine whether the gain is a net. one relative 
to the known or projected target knowlcdgca bility . 

The substantive r esponsibiliti e.s of the DIPA are clear but what 
is siot clear is his management responsibility as relative to the ASD/I 
.evaluation effort. For example, should not the DIPA be responsible for 
the integrated evaluation of current net information gain for all sensor 
relative to given targets? 


Recommendation number 4 is unnecessarily vague and could 
present serious management problems to the ASD/l. For example. 


a. Expand the 1\'S A responsibilities in what specific manner 
bv .what criteria? 


■ b. Again the processing and reporting problem as it 
IP A and the production function is present. 


c. -'What docs "Data Base Maintenance" mean? The inte- 
grated substantive data base is maintained by the production function 
(DIPA) . What "Data Base." does DSECC or NS A maintain? 


^s’a final note the report docs hot deal with the impact of Defense 

Executive Agent resource decisions as they relate to non-Defcnse aser.cie 

Nor does it deal explicitly with the- problem of "National" program 

resources managed by non-Defcnse agencies or non -Defense resources 

for all functions which provide intelligence inputs collection, processing 

and production on Defense matters (both to the Defense and the National 
. ■ . ’ ’ * 
decision level). In view of the ASD/I evaluation function and the NIRB 

evaluation function at the- National level, the question may well be asked 

whether committees at the national level as presently constituted are 

needed or desirable.- It would appear that the ASD/I and the DCI have 


- r\ (pk r * a j.- • > p -r 
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passed the stage of making judgments without adequate staff support on 
single collection programs proposed by single program officers who 
cannot and do not assess ‘the impact of other collectors, processors, 
producers, and the consumer needs of policy decision makers. 

Operating resource, managers are to be denied the policy manage- 
ment sovereignty over their individual, efforts, if the' panel rcccmmenda- 
lions are implemented. Modern intelligence is a complex system with 
interrelated collection, processing production, support, and management 
subs-y stems . Policy management decisions cannot be fragmented in 
terms of individual operating management power if, efficiency and 
off ectivenoss are to be gained at lower fiscal inputs. The operating 
barons will merely share the reduction with little regard for impact on 
uforfs and functions not within their- direct management concern. This 
war in fact, the primary modus operand! in' formulating Intelligence 
Pi seal Guidance in the FY 19 72 CD IP exorcise. We cannot allow it to 
happen again, if intelligence is to be an effective service to National and 
Defense decision and less an end in itself. 


f. 


'X'J CWR 

Wallace F. Seidel 
Director of CIR1S 
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Juno 15, 1970 


HiOD'JCl' EVALUAT20H - A SUGGESTED APPROACH 


f. o ! if. '?091 
arlingtjn, va* 


v. As Product Evaluation? 


.. ... I 

Product evaluation is the process by which an 'intelligence o rgam k&uio a 
RR ncA'os ‘the of foctivenoss of specific products sent out to meet the 
rebut* omc-nts levied by the concur, -or.. The I'ccsuirenents nay be explicitly 
at;; ’ od or o.olv implied by the current activities of the consumer, but an any 
cane t‘v;y are within the general guidelines i-egarding priority of intelli- 


IV' 


The evaluation of so 


snp.f'.i 


1 1 


produces is 


r , * i vni 

it* 1 


'uo cne 


'.ft. 


a aka of program evaluation. 


The simple appreaen u> proau 
sroly 

*J„juL O .l”IT<c 1 OXO 51 t/OCl 


eva.uuit-i.on 

1 s 


for 


the intelligence 


rsr-uly to ask the consumer how he $ the producer, is doing, is the 


r.j. 


■;0 ; ; 


a ;.»cgcr comp 


consumer v;nr&u v?as 
. <‘c;i go nudgem entsf 


J. ^ ' 
i C/ odu.-. j 

wheth' 

• S R l-'-* 

ate, t 

don? 

. Is i' 



• the 

in tel 


a single iact relating to a. weapons 
; which the consumer requires to do his 
timely? is the format most u: 

... .J. _ "I «. .• . _ . . - - - - 

lil X iiJ. V' J. .lie- vJ Ji HiV-Cwi 


; O .c u_L > 

.• A. .1 'J 


explicitly known and not known as tho basis for the 


But this simple approach has never 'worked. The volume of products is 
too great* There is a vri.de variety of consumers » with tho variety being botr 
horizontal and vertical in tho bureaucracy < In taany oases the consumer 
cannot really be sure whet he needs in advance, or' how best to formulate his 
rsouireuent to gain the most effective response. The test of adequacy of the 

relative to available information must in most 


Vi 


I -p.-' ■ v* VJn. 


0g£n\nz cf further information or of actual developments taking 


itu.ro. (the ‘derivation of lesson learned). 


But one might ask why is the existing system of levying requirements 


net ado: no? Is there a pressing need for other than periodic general* 


implicit in 


too u I r crri e n tr s v s ‘C ctra / 


A ■pi* Ai y» *-\ **> I L r 

2 *_L vc-l v*-.-—- w** * v 


J.. i i U» 



IV, V, 

community 

IS 

so or 

v?hi 

Cb 

i- v.' \ 

■uire 

-. onus n av 

be 

levie 

The 

c,A 

rec 

.uire 

cents stari 

;e what t 


ci: 

'i c 

Vein 

b in time 

(or 

hi s 

age 

HO; 

*■ w • 

i iv. 

i s to 

do is to 

respond, 


there is a sub- system through 
i on to the appropriate producer, 
believes he needs to know at the 
future needs). All the intelligence 


DO 


~ “1 
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However, as it has turned out. 

the 


.‘0 C; L-.i.O 

n.Vng of 


tb -arctic than effective-. Thor 

b* L J 

r O 
• 

been 

serious 

■ ff'.Y.j 

.rm.n nt is only for finite piece 

r- of 

a; 

t. 0 

For ox a- 

s' £■»!•« 

: for levying scientific requir 

omen 

»- i » 

in i'.li 

a Army 

V' . * 

,;.i almost totally ineffectual be 

cans 

* c. 

»f the 

lack o 


V, : 1 0 sys.'-Om na'C Dfcen 
problems oven where 
pie . a survey oi vh< 
.$•!) community found 
communion u j.cn wc c.: 
lex 'products arc ne- 
ed including into. grated estimates of future development^!, the problems of 
cossmuni cation « and wore specif i coolly of continuous feed-back remain largely 
unresolved* Tnus, the problems that have developed in relating the Ubiu 


l 

i 


national estimating process to the KSSM system, Account should bo taken of 
the fact that- often the consumer* s vie v; of v:hat he needs changes substantial- 
ly between the time ho lays on the requirement end when ho id putting together 
a draft of c. plan or a policy decision or looking for the threat to fit with 
ivl'.:! development problem, that inevitably happens is a learning process on 
the part of the consumer and an interaction in his mind (or that of his staff 
relating continuing developments on the US side to those presented by intej.li. 
gone*.. But seldom is the intelligence producer made a full partner to this 
icruniv; process* . . 

Involved also is the related major problem of ascribing priorities to 


on turner 5 s stated requirements. 


Given 


Jor. siting resources, vnucn pro- 


dWu.L V 


xn~ 


I;. - arc most necessary? The consumer has been reluctant 
... . .... -cnee is limited by the availability of funds. The consumer must state" 
v./ ... c . v a y i n pn exol o-j t context which takes account of the many 

- ' v » •. ^ 5 

•../vuui- co visum a. s ’at many levels of government. But existing priority guidlinos 
are at best too general to be effective with adjusting priorities among 
•soccifie products* Thus, part of product evaluation must be to relate the 
specific product to an explicit order of priority, 

» 


b restate, the problem of product evaluation is to determine the ext op 

2 to i 

etc.)* Part of thi 


.eh products of the intelligence system are responsive to consumer needs 


iuc-iv S 


veaoon system clevelooers, 


'■ J ' r ' ^rmlne how the consumer needs are stated and whether they 


(.the planners,, decision 

1*0 it V U 'w* 

an effective communication of what in fact were the actual needs 
:.t of the problem is to determine how the intelligence ccmmnnit' 


itself Structured to .receive z'nc 


consumer statement 02 


nc 


id 


that is, who 

ecvivos it. how is it communicated to the several functional areas which 
use be involved in filling the requirement, how coos its priority within 
ho ' intelligence system match that in the consumer world? Finally, part of 
lien is to convince both the consumer and the. Intel 'M r 
we is a major problem 
consumer acting as his own intelligent 


oi) 


In many instances the oroblem is done salved 


officer e; 


XT' 


. b cnce or facer 
ebeau, 


o: 


nr. s 


ii s aorointment with the intelligence incuts or because he believes ho 


a fact knows ...oro (or hit judgement is better). On the other hand, there 
.£ a traditional view held by many professional intelligence officers that 
•boy know best what should be produced* 
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, >1 oC product evaluation ir; of on ch ;i Magnitude that it ru 
u * y ,» nor,n.-nvnt .-.yetcm* It cannot effectively he accompli;..; 
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thu following paragraphs set forth attributes which a system of product ^ 
ovr. -.nation should have and its general mode of operation* . j 

Product 'evaluation can bo broken down into two general phases, the first 
o'” wbi ob could bo considered as preventative maintenance* Efforts would be 
node in selected area s to determine the possible cficcts of. developing Sx cua- 
tiers on requested px-b ducts* The second phase wou.i.d be the more normal eiiort 
to deter:.: in o, after production, the extent to which the product fulfilioo. t-ne 
rocmix'oacnt and was* used by the consumer. T)ie product evaluator must know 
t!rr intelligence system, the problems of the consumer, and have access co tno 
consumers’' end studies, reports, or whatever encompasses the intelligence 

tfOc * _ 

.... . , . * 

iBoCciixCv Oi olio jiixO*. ti oX y. c *t xy o~C p x*g o.n c c s 5 t<ho cvc\-ivici lAxO-G sy s vCKi ha cl s c 
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to the consumers would be adequate* For others, personal contact voula do 
required* For some the rconiren ent s system could be used for spec, checxing. 

In order to make the operation manageable the focus of efiort snoulo. be 
determined largely on the oasis of cost- of proouct (or iamily onereoi) 
and/or its position in the priority, listing. 


To match the dynamic nature of intelligence, the evaluation system 
must avoid being static in its methods* Especially among the more impor- 
tant consumers in the planning and policy decision echelons of government, the 
sve tor, shovl^l not be mechanistic but capable of reflecting changes in the ^ 
situation Kg’ they iraoinfre on .reauirexents. 

J *■ =*- ' i 

i 

The evaluators must be made responsible to comment on how ohe results 
of their analysis of product reflects the operation of other elements 
.. . u ' intelligence process. Produced intelligence is the product of the 
r .v ... - t 1 g on oo process — coj*lectxon, processing, and proouc owcn* x:.e 

yg c.; of the end product, therefore, is in a real sense an ^ evaluation 
of fro functioning of the whole system and thereby becomes ah important data 
r. ■ 'row well it is functioning. And because of this close relationship 
■ , ...... 'f; ■ pmcoss the evaluators must not be cart of any producing element 

or cth ;;o they would be evaluating themselves. 
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o arrant the evaluators, there should bo relatively specific intelx 
rieritiee efitf.'o:i.:!.Khcvl. Those should sot the guidance for the reqir 
V ;i \)v the consume**,. While there pro general principlbs establish 
i.or.r ; National Intelligence. Objectives', and Annex A of the Joint 
dr-orations Plan, they ore rot specific enough to be effective, 
y during o. period of budgetary stringency* The evaluator can cssj.s 
V s: ; p3:.woirc. of specific priorities since' ho will b,e continuously 


iu s within the government. 
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the shifting policy and planning frfeus 

the program evaluation office 
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■'nrin.g nature of priori tie *3 and of the functioning of the xntclxxg- 
recess are essential inputs to the' program evaluator. But in turn 
riru! evaluator can keep* the product evaluators aware of program pres- 
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v;d would be able to provide price 
ne latter is mi ess— 


r rho various xivccju xgenco products. -ns ramie. xs an o u s«:iuj.ui 
tuition for use by the produce evaluator. He can -remind the consumer * 
[•.elligonca is not a free good but one with a cost and, therefore , 

,-ot be a relative value ants. cried to the product. There will never 
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vtunc , the production staff in */LA is co tainting whwt has boon tno 
nir.aed approach to the problem. But -again this xs on ao. hoc. enox-t 
az at the present time) . To in sure a fully effective x*esponse to 
once needs, the intclliecnce community must continously evaluate its 


v.'ith the above considerations in mind , it is recommended that' a protract 
vslvu .tion office be ostalished in each, intelligence agency which produces 
• 5 *:? td intelligence (CIA, JjGCA, State, Army, Navy, and Air Force). This 
.ffioo should be^ located as an' element of the program review office.^ If this 
a not desired then it could cither' bo in the Inspector General 5 s office or 
ct. as an independent staff agency within the office of the director. In 
■v chs? fvorld* this element be within the office responsible for production 
for the -orocossinr of requirements. 


The office mould be staffed with senior, experienced intelligence 
i while their tours should be rotational (to maintain a dynamic 

pro ecus} , tl>o tours should bo for at least three years to enable the ' 
'xc re to become fully knowledgeable of all facets of the intelli gen ce 
rati ?; and,noro importantly, of t'uo operation and needs of the consumer 
fd.b. In, certain important areas, such as national level policy and planning 
imclligonoe officers could be augmented by 'experienced officers from the 
5 armor agencies. The intelligence and operations or planning officer vrouid 
;■!; in teams, bringing both sides of the problem together in a very explicit 


As th^problora is community wide and there is overlap both in terms 
f subject matter in produced etbeumonts and in the several consumers 5 
noducts, evaluation should be coordinated amongst all intelligence agencies, 
'his coordination would focus on the exchange of information conerning eon- 
... • needs, the extent to which various documents appear to meet or not uo 
.cot the needs, and the approaches being used in product evaluation. , 

>«pix cation would also be discovered in this manner. The coordinating 
ospousibilCity should be given, to the MiPx staff of the 0C1, which would 
•a responsible for organising and staffing an, interagency committee, 
x thing the NIPS staff, the role should be given to the staff element res- 
on.bhle for the iiJRB, thus insuring coordination at the highest level 

on program and product evaluation. The NIPS staff would also have the 
•-span sib: .city for product evaluation of community produced papers such as 
u. clonal Intelligence Estimates. 
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'-he product evaluators, specifically, wulcl execute their respbn- 
ribilitie:? by focussing on the following racks: 

1„ Ur F® the development of more specif a c listings ox xu cein 


geuoe priorities* 

Z Devoi oo a cost for major production items •* exlncr single 
He-*. Wjodlc production of single items, or a. class of proauevon suca 
as the case -here there is a basic document followed by wanting re w * 

3 Rate consumer agencies and requested major items in terms 
( r ,; f.nnarent) crioritv and cost or product. Use mis as a oasis 
The extent- of personal contact would be determined by uio 
''•‘•'b & yy. Table 'bo the evaluation staff and me number of 

c'"itv. high cost- items. 

4, Within the limits of available manpower, deyejop a close 
v-<^ re^tionshio with the consumer staffs using high priority, nip cosi 
r^Vonce products. Seek to improve thdir understanding or intelligence 
ft' ,',;V ; , r .d‘tho intelligence producers* comprehension or the intelligent 
‘ rv-'^bcrOar, develoo an awareness of changes in requirements as a 
0 f chan-W policy and/or the situation in areas critical to unese 

A some instances, ; the evaluator may have to aeai aeiieatoiy 
;b 1 f b ,.j.* !0 ,,g v --ere intelligence inputs become lost in tne pressure to 
r^^^Vreed policv cater-. While this should be reported, pc fact 
Vs thr ^intelligence produces ~ but tho consumer disposes, invol-x- 
Va limited to tho pressures exerted by the tacts obtained 

and the Wncy of its argument. It has trouble insisting it oe used. m 
.any particular way. • -- 

5. bevel 00 s - system whereby consumer products which 'use in- 
; ’=de available for review. To determine the actual 
^p^Vntonirence, each draft in the process of developing the final 
■ consumer oroduct should be obtained. In this manner the source ana use 
-bx 5 root: bio Modification of) the intelligence input can be traced. 
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o, Develop ft rystcri for relax '> ng changes in consumer r cquir cxcnt 3, 

v to in- being projects to the producers. J r\ format ion should include 

for changes as v.'cO.I as non state. cents of requirement s« Tn to mo cases ; 

j.:.J b. : involved • is continuous \wfcin:’ relationships by evaluators v;i'th 

:ors and tircducors to interpret developing requirement s«. 

. ‘ ! » 

I 

?«. Review the- requirements system in operation and arrange for- ao'oess 

• * 1 „ ' m 

[aired and for the receipt of suggestions as they develop. .Votcxpt 
ulop neons where by the requirement s procedures inxjrht alto be used to gain 
data;, or- usefulness of what appears to he less important (less valuable? ) 


a- I 
in CO SYf; 


* 

8* V?ork with program evaluators to clarify critical areas ox 
by once re quir orients and consumer priorities as indicated by product ’ 
d/or suggested jr^difi elation. The latter vrould be particularly * 

r.nt where it referred specifically to collection requirements* 







